Ensemble of Hankel Matrices for Face Emotion Recognition

In this paper, a face emotion is considered as the result of the composition of multiple concurrent signals, each corresponding to the movements of a specific facial muscle. These concurrent signals are represented by means of a set of multi-scale appearance features that might be correlated with one or more concurrent signals. The extraction of these appearance features from a sequence of face images yields to a set of time series. This paper proposes to use the dynamics regulating each appearance feature time series to recognize among different face emotions. To this purpose, an ensemble of Hankel matrices corresponding to the extracted time series is used for emotion classification within a framework that combines nearest neighbor and a majority vote schema. Experimental results on a public available dataset shows that the adopted representation is promising and yields state-of-the-art accuracy in emotion classification.Comment: Paper to appear in Proc. of ICIAP 2015. arXiv admin note: text overlap with arXiv:1506.0500

Dynamic displacement of normal and detached semicircular canal cupula

© 2009 The Authors. This is an open-access article distributed under the terms of the Creative Commons Attribution Noncommercial License. The definitive version was published in JARO - Journal of the Association for Research in Otolaryngology 10 (2009): 497-509, doi:10.1007/s10162-009-0174-y.The dynamic displacement of the semicircular canal cupula and modulation of afferent nerve discharge were measured simultaneously in response to physiological stimuli in vivo. The adaptation time constant(s) of normal cupulae in response to step stimuli averaged 36 s, corresponding to a mechanical lower corner frequency for sinusoidal stimuli of 0.0044 Hz. For stimuli equivalent to 40–200 deg/s of angular head velocity, the displacement gain of the central region of the cupula averaged 53 nm per deg/s. Afferents adapted more rapidly than the cupula, demonstrating the presence of a relaxation process that contributes significantly to the neural representation of angular head motions by the discharge patterns of canal afferent neurons. We also investigated changes in time constants of the cupula and afferents following detachment of the cupula at its apex—mechanical detachment that occurs in response to excessive transcupular endolymph pressure. Detached cupulae exhibited sharply reduced adaptation time constants (300 ms–3 s, n = 3) and can be explained by endolymph flowing rapidly over the apex of the cupula. Partially detached cupulae reattached and normal afferent discharge patterns were recovered 5–7 h following detachment. This regeneration process may have relevance to the recovery of semicircular canal function following head trauma.Financial support was provided by the NIDCD R01 DC06685 (Rabbitt) and NASA GSRP 56000135 & NSF IGERT DGE- 9987616 (Breneman)

Social robots as psychometric tools for cognitive assessment: a pilot test

Recent research demonstrated the benefits of employing robots as therapeutic assistants and caregivers, but very little is known on the use of robots as a tool for psychological assessment. Socially capable robots can provide many advantages to diagnostic practice: engage people, guarantee standardized administration and assessor neutrality, perform automatic recording of subject behaviors for further analysis by practitioners. In this paper, we present a pilot study on testing people’s cognitive functioning via social interaction with a humanoid robot. To this end, we programmed a social robot to administer a psychometric tool for detecting Mild Cognitive Impairment, a risk factor for dementia, implementing the first prototype of robotic assistant for mass screening of elderly population. Finally, we present a pilot test of the robotic procedure with healthy adults that show promising results of the robotic test, also compared to its traditional paper version

Evaluation of a robot-assisted therapy for children with autism and intellectual disability

It is well established that robots can be suitable assistants in the care and treatment of children with Autism Spectrum Disorder (ASD). However, the majority of the research focuses on stand-alone interventions, high-functioning individuals and the success is evaluated via qualitative analysis of videos recorded during the interaction. In this paper, we present a preliminary evaluation of our on-going research on integrating robot-assisted therapy in the treatment of children with ASD and Intellectual Disability (ID), which is the most common case. The experiment described here integrates a robot-assisted imitation training in the standard treat‐ ment of six hospitalised children with various level of ID, who were engaged by a robot on imitative tasks and their progress assessed via a quantitative psycho- diagnostic tool. Results show success in the training and encourage the use of a robotic assistant in the care of children with ASD and ID with the exception of those with profound ID, who may need a different approach

The Effect of Auditory Distraction on the Useful Field of View in Hearing Impaired Individuals and its implications for driving

This study assessed whether the increased demand of listening in hearing impaired individuals exacerbates the detrimental impact of auditory distraction on a visual task (useful field of view test), relative to normally hearing listeners. Auditory distraction negatively affects this visual task, which is linked with various driving performance outcomes. Hearing impaired and normally hearing participants performed useful field of view testing with and without a simultaneous listening task. They also undertook a cognitive test battery. For all participants, performing the visual and auditory tasks together reduced performance on each respective test. For a number of subtests, hearing impaired participants showed poorer visual task performance, though not to a statistically significant extent. Hearing impaired participants were significantly poorer at a reading span task than normally hearing participants and tended to score lower on the most visually complex subtest of the visual task in the absence of auditory task engagement. Useful field of view performance is negatively affected by auditory distraction, and hearing loss may present further problems, given the reductions in visual and cognitive task performance suggested in this study. Suggestions are made for future work to extend this study, given the practical importance of the findings

A neural circuit model of decision uncertainty and change-of-mind

Decision-making is often accompanied by a degree of confidence on whether a choice is correct. Decision uncertainty, or lack in confidence, may lead to change-of-mind. Studies have identified the behavioural characteristics associated with decision confidence or change-of-mind, and their neural correlates. Although several theoretical accounts have been proposed, there is no neural model that can compute decision uncertainty and explain its effects on change-of-mind. We propose a neuronal circuit model that computes decision uncertainty while accounting for a variety of behavioural and neural data of decision confidence and change-of-mind, including testable model predictions. Our theoretical analysis suggests that change-of-mind occurs due to the presence of a transient uncertainty-induced choice-neutral stable steady state and noisy fluctuation within the neuronal network. Our distributed network model indicates that the neural basis of change-of-mind is more distinctively identified in motor-based neurons. Overall, our model provides a framework that unifies decision confidence and change-of-mind

The human semicircular canal model of galvanic vestibular stimulation

A vector summation model of the action of galvanic stimuli on the semicircular canals has been shown to explain empirical balance and perceptual responses to binaural-bipolar stimuli. However, published data suggest binaural-monopolar stimuli evoke responses that are in the reverse direction of the model prediction. Here, we confirm this by measuring balance responses to binaural-monopolar stimulation as movements of the upper trunk. One explanation for the discrepancy is that the galvanic stimulus might evoke an oppositely directed balance response from the otolith organs that sums with and overrides the semicircular canal response. We tested this hypothesis by measuring sway responses across the full range of head pitch. The results showed some modulation of sway with pitch such that the maximal response occurred with the head in the primary position. However, the effect fell a long way short of that required to reverse the canal sway response. This indicates that the model is incomplete. Here, we examine alterations to the model that could explain both the bipolar and monopolar-evoked behavioural responses. An explanation was sought by remodelling the canal response with more recent data on the orientation of the individual canals. This improved matters but did not reverse the model prediction. However, the model response could be reversed by either rotating the entire labyrinth in the skull or by altering the gains of the individual canals. The most parsimonious solution was to use the more recent canal orientation data coupled with a small increase in posterior canal gain

Neural and behavioral traces of error awareness

Monitoring for errors and behavioral adjustments after errors are essential for daily life. A question that has not been addressed systematically yet, is whether consciously perceived errors lead to different behavioral adjustments compared to unperceived errors. Our goal was to develop a task that would enable us to study different commonly observed neural correlates of error processing and post-error adjustments in their relation to error awareness and accuracy confidence in a single experiment. We assessed performance in a new number judgement error awareness task in 70 participants. We used multiple, robust, single-trial EEG regressions to investigate the link between neural correlates of error processing (e.g., error-related negativity (ERN) and error positivity (Pe)) and error awareness. We found that only aware errors had a slowing effect on reaction times in consecutive trials, but this slowing was not accompanied by post-error increases in accuracy. On a neural level, error awareness and confidence had a modulating effect on both the ERN and Pe, whereby the Pe was most predictive of participants’ error awareness. Additionally, we found partial support for a mediating role of error awareness on the coupling between the ERN and behavioral adjustments in the following trial. Our results corroborate previous findings that show both an ERN/Pe and a post-error behavioral adaptation modulation by error awareness. This suggests that conscious error perception can support meta-control processes balancing the recruitment of proactive and reactive control. Furthermore, this study strengthens the role of the Pe as a robust neural index of error awareness

Heterothermy and seasonal patterns of metabolic rate in the southern African hedgehog (Atelerix frontalis)

Animals that inhabit unfavourable habitats and experience seasons where the cost of maintenance exceeds the available energy resources have over time developed behavioural and physiological mechanisms to survive. These adaptations include changes in activity, improvement of cold tolerance by using nonshivering thermogenesis (NST), improvement of thermal conductance, reduction of body mass, or acclimation to colder temperatures (reduction of metabolic requirement). In addition some species exhibit heterothermy, in the form of either daily torpor or longer-term hibernation. The southern African hedgehog (Atelerix frontalis) is an excellent candidate to investigate the phenomenon of heterothermy because it is a small insectivore (summer body mass ca. 300 to 400g), burrows, inhabits harsh habitats and is not easy to find during the winter months. In this study I aimed to investigate whether A. frontalis exhibits seasonal differences in metabolic rate and furthermore if this species exhibits heterothermy. The study was carried out in the Northern Cape Province, South Africa. Hedgehogs were hand captured and their metabolic rates were measured using indirect calorimetry. Individuals were implanted with temperature dataloggers for a summer period (November 2009-January 2010) and a winter period (May-August 2009). The summer BMR of adult A. frontalis (0.448 ±0.035 mlO2/g/h, n=4) was significantly lower than their winter BMR (0.811 ±0.073 mlO2/g/h, n=4) and statistical analyses revealed that this was an affect caused by seasonal changes in the ambient environment. Individuals spent up to 84 percent of time during the measurement period torpid (-8°C <Ta<21°C). Body mass appears to be an important factor in determining the pattern of heterothermy (daily torpor versus hibernation) used in this species. To my knowledge the extremely low body temperature (Tb min) of 1.0°C recorded for A. frontalis is the lowest Tb min recorded for a mainland Afrotropical mammal. This species displays classic up-regulation in metabolic rate during winter, resulting in an increase in the energetic requirements of the species. As a result, heterothermy appears to play a significant role in the energy balance of this species during winter, contributing to energy saving. Heterothermy may enable this species to survive in the face of global climate change